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Abstract — Consider a if -user interference channel under a 
block fading model. At any particular time, each receiver will see 
a signal from most transmitters. The standard approach to such 
a scenario results in each transmitter-receiver pair achieving a 
rate proportional to the single user rate. However, given two 
well chosen time indices, the channel coefficients from interfering 
users can be made to exactly cancel. By adding up these two 
signals, the receiver can see an interference-free version of the 
desired transmission. Thus, each user can achieve an ergodic rate 
proportional to i the single user rate. In this paper, we apply this 
technique to a finite field interference channel to find the ergodic 
capacity region. Furthermore, we find a simple description for 
the achievable ergodic rate region in the Gaussian setting. 

I. Introduction 

The interference channel is one of the fundamental building 
blocks of wireless networks. Following several recent ad- 
vances, the capacity region of the classical two-user Gaussian 
interference channel is known exactly for some interesting 
special cases (e.g. very weak or strong interference), and 
approximately (within one bit) for all channel conditions [1]. 
There is also increasing interest in generalizations of the two- 
user Gaussian interference channel model to more than 2 users 
and fading channels. However these generalizations turn out 
to be far from trivial, as they bring in new fundamental issues 
not encountered in the classical setting. Extensions to more 
than 2 users have to deal with the possibility of interference 
alignment [2], [3] while extensions to fading channels are 
faced with the inseparability of parallel interference channels 
[4], [5]. Interference alignment refers to the consolidation of 
multiple interferers into one effective entity which can be sepa- 
rated from the desired signal in time, frequency, space or signal 
level dimensions. The inseparability of interference channels 
refers to the necessity for joint coding across channel states. 
In other words, for parallel Gaussian interference channels, 
the capacity cannot be expressed in general as the sum of the 
capacity of the sub-channels. 

The following example presented in [4] to establish the 
inseparability of parallel interference channels forms the rele- 
vant background for this work. Consider the 3-user Gaussian 
interference channel with the channel matrix: 



Hx 



(1) 



where y 



[Y U Y 2 ,Y 3 ] T , x = [X 1 ,X 2 ,X 3 ] T , 
[Z\, Z 2 , Z 3 ] T are the vectors containing the received symbols, 
the transmitted symbols and the zero mean unit variance 



additive white Gaussian noise symbols for users indicated by 
the subscripts. The transmit power constraint for each user is 
E[X|] < P, k = 1, 2, 3. Consider two different values of the 
channel matrix, 
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It is shown in [4] that taken individually either channel 
matrix H a or Hb by itself results in a sum capacity of 
log(l + 3P), so that separate coding can at most achieve a 
capacity 21og(l + 3P). However, taken together, the capacity 
of the parallel interference channel is 31og(l + 2P) which is 
achieved only by joint coding across both channel matrices. 
The key is the complimentary nature of the two channel 
matrices, i.e. |(H a + Hb) = I which allows the receivers to 
cancel interference by simply adding the outputs of the parallel 
channels, provided the transmitters send the same symbol over 
both channels. 

In this paper, we take this idea further by recognizing 
that in the ergodic setting, for a broad class of channel 
distributions, the channel states can be partitioned into such 
complimentary pairings over which interference can be aligned 
so that each user is able to achieve (slightly more than) half of 
his interference-free ergodic capacity at any SNR. Prior work 
in [3] has shown that for fading channels every user is able to 
achieve half the channel degrees of freedom. In other words, 
each user achieves (slightly less than) half of his interference- 
free capacity asymptotically as SNR approaches infinity. Fairly 
sophisticated interference alignment schemes are constructed 
to establish this achievability. However, in this work we show 
that for a broad class of fading distributions, including e.g. 
Rayleigh fading, alignment can be achieved quite simply and 
more efficiently. In particular, every user achieves (slightly 
more than) half of his interference-free ergodic capacity at 
any SNR. Note, however, that the stronger result is obtained 
at the cost of some loss of generality due to the assumption of 
ergodic fading and certain restrictions on the class of fading 
distributions, that are not needed in [3]. 

The next section presents the main problem statement, 
where we formulate both a finite-field and a Gaussian interfer- 
ence network model. In Section Hill we derive an achievable 
scheme for the finite field model in Section [III] and in Section 
rvl we show this matches the upper bound exactly. In Section 



IIV1 we give an achievable scheme for the Gaussian model 
which we show is quite close to the outer bound for the equal 
SNR case for any number of users. We conclude the paper in 
Section IVTl 

II. Problem Statement 

We consider both a finite-field model and a Gaussian model. 
First, we will give definitions common to both models. There 
are K transmitter-receiver pairs (see Figure [T). Let n denote 
the number of channel uses. Let each message w k be chosen 
independently and uniformly from the set {1, 2, ... , 2 nRk } for 
some R k > 0. Message w k is only available to transmitter k. 
Let X be the channel input and output alphabet. Each trans- 
mitter has an encoding function, £ k , that maps the message 
into n channel uses: 



£k ■ {1,2, 



-,nR k 



} x n 



(3) 
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Fig. 1. .ft'-user interference channel with fading. 

We focus on the fast fading scenario where the channel 
matrix changes at every time step. Let H(t) = {h k t[t)}kt 
denote the channel matrix at time t and let H" denote the 
entire sequence of channel matrices. We assume that before 
each time step t, all transmitters and receivers are given perfect 
knowledge of the channel matrix H(t). 

At time t, the channel output seen by receiver k is given 
by: 



A" 



Y k (t) =J2hki(t)X e (t) + Z k (t) 



(4) 



where Z k (t) is additive noise. Note that addition is carried 
out over a finite field or the complex field, depending on the 
channel model. 

Each receiver is equipped with a decoding function: 



V k ;X n ^{l,2,...,2 nHk } 



(5) 



and produces an estimate w k of its desired message w k . 

Definition 1: We say that an ergodic rate tuple 
(Ri, i?2, ■ ■ • ! Rk) is achievable if for all e > and n 



large enough there exist channel encoding and decoding 
functions £ i , . . . , £k , T>\ , . . . , T>k such that: 

R k >R k -e, k = l,2,...,K, (6) 
Pr({w! ^ wi}U...U{% ^ w K }) < c (7) 

Definition 2: The ergodic capacity region is the closure of 
the set of all achievable ergodic rate tuples. 

A. Finite Field Model 

The channel alphabet is a finite field of size q, X = ¥ q . The 
channel coefficients for block n, h k t, are drawn independently 
and uniformly from ¥ q \ {0}. 

Remark 1: Our results can be extended to the case where 
the channel coefficients are sometimes zero through simple 
counting arguments. However, this considerably complicates 
the description of the capacity region. 

The additive noise terms Z k (t) are i.i.d. sequences drawn 
from a distribution that takes values on uniformly on 
{1,2, ...,<; — 1} with probability p and is zero otherwise. 
We define the entropy of Z k (t) to be < H(Z) < log 2 q. 

B. Gaussian Model 

The channel inputs and outputs are complex numbers, X = 

C. Each transmitter must satisfy an average power constraint: 



E 



\X k (t)\ 2 H(t) 



< SNRi 



(8) 



where SNR^ > is the signal-to-noise ratio. The channel 
coefficients for each block are drawn independently accord- 
ing to a Rayleigh distribution, h k g ~ CAf(0, 1). The noise 
terms are i.i.d. sequences drawn from a Rayleigh distribution, 
Z k (t)~CAT(0,l). 

Remark 2: The per-symbol power constraint eliminates the 
need to search for the optimal power allocation policy. A non- 
equal power allocation over channel states could certainly be 
included as part of our scheme but for the sake of simplicity we 
explicitly disallow it. See [6] for a study of power allocation 
for fast fading 2-user interference channels. 

Remark 3: We could also allow for different interference- 
to-noise ratios between each transmitter and receiver (usually 
written as INRfe^). However, the achievable rate derived in 
Section [IV] would still only depend on the SNRfc parameters. 

III. Finite Field Achievable Scheme 

We now develop an achievable scheme for the finite field 
case that can approach the symmetric ergodic capacity. First, 
we need some tools from the method of types [7]. Let Tt 
denote the alphabet of the channel matrix so that H(t) £ Tt. 
Let iV(H|H") be the number of times the channel matrix 
H G TC occurs in the sequence H". 

Definition 3: A sequence of channel matrices, H", is 5- 
typical if: 



2V(H[H n ) - P(H) 



< 5 



(9) 



where P(H) is the probability of channel HeH under the 
channel model. Let Ag denote the set of all ^-typical channel 
matrix sequences. 

Lemma 1 (Csiszar-Kdrner 2.12): For any i.i.d. sequence of 
channel matrices, Hg, the probability of the set of all <5-typical 
sequences, Ag, is lower bounded by: 



(10) 



For a proof, see [7]. 

Lemma 2: There exists a one-to-one map, g : ¥ q <yK — » 
Ff xK such that H + g(H) = I, VH where I is the identity 
matrix. 

Proof: Let / : F q — > F g be the one-to-one map such that 
/(a) + a = 1 for all a £ ¥ q . Since F 9 is a finite field, /(•) 
is guaranteed to exist. Then, define g(-) as follows: 



9(H) 



/(/in) 



-hi2 
f(h 22 ) 



-h 



Kl 



I-K2 



-hiK 
-h 2 K 

f(h KK ) 



(11) 



where — hkt is the additive inverse of hki- Clearly, g(H)+H = 
I and g(-) is one-to-one. ■ 

The basic idea underlying our scheme is to have each 
receiver decode a linear function of transmitted messages 
according to the channel coefficients. The receiver then pairs 
channel matrices according to the previous lemma and adds up 
the appropriate functions to recover the desired message (by 
canceling out all others). We make use of computation codes 
to recover functions of messages reliably at the receivers [8]. 

Lemma 3 (Nazer-Gastpar): Consider a K-user finite field 
multiple-access channel with channel output: 



Y(t) 



K 

£ 

fc=l 



h k X k {t) + Z{t) 



(12) 



with fixed channel coefficients hf- € ¥ q and i.i.d. additive 
noise Z(t) with entropy H(Z). Each transmitter has a mes- 
sage Wfe e F™. The maximum rate, R = ^ log 2 q, at 
which the receiver can reliably recover the linear function 



u = }~2k=i h ^k is given by: 



R = log 2 q-H(Z) 



(13) 



See [8] for a full proof. The construction relies on the use of 
linear codes. 

We will now show that all users can achieve half the single 
user rate simultaneously. 

Theorem 1: For the if -user finite field interference channel, 
the rate tuple (i? S YM, -Rsym, ■ • ■ , -Rsym) is acheivable where : 



R s ™ = \{\og 2 q-H{Z)) 



(14) 



Proof: For any e > 0, choose 6 < | and using Lemma Q] 
choose n large enough so that P(Ag) > 1 — §. Assume that 
S and n are chosen such that is an even integer. Now 

condition on the event that the sequence of channel matrices, 



H™, is (5-typical. Since the channel coefficients are i.i.d. and 
uniform, the probability of any channel H S Ti is ^ . Since 
H™ is ^-typical we have that for every H S H: 



n(l - S) 

\n\ 



< iV(H|H n ) < 



n(l + S) 



(15) 



Throw out all but the first "^L,' 5 ' 1 blocks for each channel 
realization. This results in at most a S penalty in rate. Group 
together all time indices that have channel realization H and 
call this set of indices 7h. We will encode for each 7h sepa- 
rately. Let i? BLO cK = 5(log2 q~H{Z)) — §. For the first ^fcp 
blocks for each channel realization H, transmitter k generates 



a message WfcH S F™ where m 



n(l-S) 



(log^)- 1 ^ 



Using a computation code from Lemma J3J each transmitter k 
sends its message w^h for during the first 2f^| ^ me indices 
in 7h. Receiver k makes an estimate UfeH of u^h where: 

(16) 



K 



u fcH = hkeWkH 



For each channel realization H G H, pair up the first 



blocks with H with the last 



n(l-S) 
2\H\ 



2\n\ 

blocks with <?(H) using 



g(-) from Lemma|2] Since g is one-to-one, this procedure pairs 
up all of the channel blocks. During the last 2p^p blocks 
with channel <?(H), the transmitters use the message, w^h, 
and a computation code from Lemma [3] The receivers make 
an estimate v^.h of v^h where 

VfeH = /(ft-fefe)w feH - 2J h kiWm (17) 

l=£k 

where /(•) is the function such that f(hke) + hkt = L 
For n large enough, the total probability of error for all 
computation codes is upper bounded by |. Receiver k makes 
an estimate of w^h by simply adding up the two equations 
to get WfcH = UfcH +VfcH- Adding up all the rates from each 
channel realization, we get that each receiver can recover its 
message at a rate greater than i(log 2 <7 — H(Z)) — e with 
probability of error less than e as desired. ■ 
Theorem 2: For the if-user finite field interference channel, 
any rate tuple (R%, . . . , Rk), satisfying the following inequal- 
ities is achievable: 



Ri + Rk <log 2 q-H{Z), Mk^l. 



(18) 



First, we will give an equivalent description of this rate region 
and then show that any rate tuple can be achieved by time 
sharing the symmetric rate point from Theorem Q] and a single 
user transmission scheme. 

Lemma 4: Assume, without loss of generality, that the users 
are labeled according to rate in descending order, so that R\ > 
R 2 > ■ ■ ■ > R K . The achievable rate region from Theorem |2] 
is equivalent to the following rate region: 



Rt < log 2 q - H(Z) 
Rk < /3(log 2 q - H{Z)) 

p = mm 1 



k = 2, 



,K 



log 2 q-H(ZY2 



(19) 



(20) 



Proof: The key idea is that only one user can achieve a 
rate higher than §(log 2 q — H(Z)). From ( TTSb . we must have 
that Ri+R 2 < log 2 q - H(Z) so if R x > §(log 2 g - #(£)) 
all other users must satisfy Rf. < 1 — R%. If i?x < | (1°S2 9 — 
iJ(Z)), then we have that i? fc < |(log 2 q - P(Z)) for all 
other users. ■ 

Proof of Theorem [2} We show that the equivalent rate 
region developed by Lemma [4] is achievable by time-sharing. 
First, we consider the case where R x > ±(log 2 <z - H{Z)). 
Let a = 2(1 — i ). We allocate an channel uses to 

V log 2 q-HIZ) i 

the symmetric scheme from Theorem [IJ For, the remaining 
(1 — a)n channel uses, users 2 through K are silent, and user 
1 employs a capacity-achieving point-to-point channel code. 
This results in user 1 achieving its target rate i?i : 



a(log 2 q - H(Z)) 



(1 -a)(log 2 q-H(Z)) 



= log 2 q - H(Z) -R t - log 2 q - H(Z) + 2R t 
= Ri 

and users 2 through K achieving Rk where: 

R k = log 2 q - H{Z) - R x 



(21) 

(22) 
(23) 

(24) 



If Ri < 2-(log 2 q — H(Z)), we can achieve any rate point with 
the use of the symmetric scheme from Theorem Q] ■ 

IV. Gaussian Achievable Scheme 

The scheme for the Gaussian case is quite similar to our 
finite field scheme. The key difference is that we need to 
quantize the channel alphabet so that we can deal with a finite 
set of possible matrices. By decreasing the quantization bin 
size, we can approach the desired rate in the limit. 

Definition 4: For 7 > 0, let Q y (hki) represent the closest 
point in 7(Z + jZ) to h^i in Euclidean distance. The 7- 



quantized version of a channel matrix H 6 



■•KxK 



by H 7 = {Q-y{h k i)}u- 

Theorem 3: For the if -user Gaussian interference channel, 
the rate tuple (Pi, P 2 , . . . , Rk) is acheivable for : 



Rk = X -E [log(l + 2|/i fcfc | 2 SNR fe )] 



(25) 



Proof: For any e > 0, choose r > such that 
P (yiki{\hkl\ > T }) < §■ Also, choose S < | and using 
Lemma Q] choose n large enough so that P(Ag) > 1 — |. 
Let 7 be a small positive constant that will be chosen later 
to satisfy our rate requirement. We will throw out any block 
with a channel coefficient with magnitude larger than r. This 
ensures that the 7-quantized version of the channel is of finite 
size. Specifically, the size of the channel alphabet H, is given 
by \H\ — (2^) 2K . We assume that t,j,5 and n are chosen 
so that all the appropriate ratios only result in integers. 

We condition on the event that the sequence of 7-quantized 
channel matrices, H", is <5-typical. Unlike the finite field case, 
the channel matrix distribution is not uniform. For all H 7 £ 7i 
we have that: 

n(l - <J)P(H 7 ) < JV(HJH2) < n(l + S)P{H 7 ) (26) 



Throw out all but the first n(l — <5)P(H 7 ) blocks of each 
channel realization. This results in at most a 6 penalty in rate. 

Let h],g denote the elements of H 7 . We define the following 
one-to-one map g : H — > H: 



,9(H 7 ) 



-hi 



-h 1 



-h 1 
h 1 

n 22 



-h 1 



-Kk 

-h 1 
2K 



ll KK 



(27) 



Note that due to the symmetry of the channel distribution 
P(g(H 7 )) = P(H 7 ). Group together all time indices that 
have channel realization H 7 and call this set of indices 
7h 7 . For each channel realization H 6 H, pair up the 
first |(1 - <5)P(H 7 ) blocks with channel H 7 with the last 
|(1 - £)P(H 7 ) blocks with channel g(H 7 ). We ensure that 
we use the same channel inputs during time index i from 7h 7 
for i — 1,2, ... , ^(1 — <5)P(H 7 ) as we do during time index 
i + ^(1 — <5)P(H 7 ) from T g (n^y Let t\ denote the first time 
and I2 denote the second time. We have the following channel 
outputs: 

Y k (h) = hkk(ti)X k (ti) + J2 hki(ti)X t (ti) + Z k (h) 



Y k (t 2 ) = h kk {t 2 )X k (h 



E 



Since t% has quantized channel H 7 and t% has quantized 
channel g(H 7 ) we have that the channel from Xk{t\) to 
Yk(ti) + Yfc(£ 2 ) has a signal-to-noise ratio of at least: 



SNR fe (2(Pe(/ lfefe ) 



If + (Im(h kk ) 



I?) 



SNR/ 



2 + 7 2 E^ fc 

is given By choosing 7 small enough, we can achieve: 



RkH,, > sup i log (l 



2|/i fefe | 2 SNR fc ) - - 



for each H 7 . The total rate per user is given by 



R k 



1 

W\ 



E 

H 7 £H 



P(H 7 )i?fcH, 



(28) 



(29) 



(30) 



Taking the limit 7 — * 0, we get: 

lim R k = 

7^0 



\ J H\h H \ >r}log(l + 2|^ fc | 2 SNR fe )P(H)dH 



Finally, taking r — > 00, we get: 



1 



lim lim R k = -P[log (1 + 2|/ lfcfc | 2 SNR fc )] 



(31) 



+007— »o " 2 

Thus, there exist 7 and r such that we achieve R k > 
5-Bpog (l + 2|/ifefe| 2 SNR fe )] - e with probability 1 - e. 



V. Upper Bounds 

We now briefly describe upper bounds for both the finite 
field case and the Gaussian case. The finite field upper bound 
matches the achievable performance thus yielding the ergodic 
capacity region. For the Gaussian case, we demonstrate that 
our achievable performance is very close to the upper bound 
when the transmitters have equal power constraints. 

Theorem 4: For the K-usei finite field interference channel, 
the ergodic capacity region is: 



Re 



R k <log 2 q-H(Z), Vfc^ 



(32) 



Proof: The required upper bound follows from steps 
similar to those in Appendix II of [3]. Without loss of 
generality, we upper bound the rates of users 1 and 2. Note 
that the capacity of the interference channel only depends 
on the noise marginals. Thus, we can assume that Z\(t) = 
h 12 {t){h 22 {t))- 1 Z 2 {t). Let Y 2 (t) = h 12 (t)(h 22 (t))- l Y 2 {t). 

We give the receivers full access to the messages from users 
3 through K as this can only increase the outerbound. From 
Fano's inequality, we have that n(Ri+R2 — e n ) where — — > 
as n — > oo is upper bounded as follows: 



< I(w 1 ;Yr)+I(w 2 ;w 1 ,Y 2 n ) 

= I(w 1 ;Y; l )+I(w 2 ;Y 2 n \w 1 ,Xl l ) 

= I( Wl ;Y{ 1 ) + I(w 2] {h 12 (t)X 2 (t) + 

= I(w i; Yn + 

I{w 2 ;{hix{t)X 1 {t) + h 1 2{t)X 2 {t) 

= I{ Wl ;Y?)+I{w 2 ;Y?\ Wl ) 

= I{w u w 2] Y?) 

< n{\og 2 q-H{Z)) 



Similar outer bounds hold for all receiver pairs k and t. 
Comparing these to the achievable region in Theorem [2] yields 
the capacity region. ■ 

Using the results from [6], we have the following outer 
bound on the ergodic capacity region of the A"-user Gaussian 
interference channel. 

Theorem 5: For the if -user Gaussian interference channel 
with i.i.d. Rayleigh fading, the following constraints are an 
outer bound to the ergodic capacity region: 



Rk + Ri 5~ E 



log! l + |/j fef | 2 SNR, 



|fr fcfc | 2 SNR fc 

\ + \h tk \ 2 sm h 



E 



log 1 



|^ fc | 2 SNR fc 



M 2 SNR^ 
1 + |M 2 SNR< 



Vfc ^ I 



In Figure [2] we plot the performance of our scheme versus 
the upper bound from Theorem [5] for the equal SNR, equal 
rate per user case. The plot is valid for any number of users 
K. This shows that ergodic interference alignment can provide 
close-to-optimal performance for any number of users so long 
as they have the same SNR constraint. 




Fig. 2. Ergodic symmetric rate per user and upper bound for 
the iC-user Gaussian interference channel with equal transmit powers: 
SNRi = SNR 2 = • ■ ■ = SNRjf. 



VI. Conclusions 

We developed a new communication strategy, ergodic in- 
terference alignment, that codes efficiently across parallel 
interference channels. With this strategy, every user in the 
channel can attain at least half the rate available to them in the 
single-user setting. Moreover, we showed that for finite field 
model this achievable scheme matches the outer bound exactly, 
thus yielding the ergodic capacity region. Future work will 
concentrate on finding the ergodic capacity region (to within 
a constant gap) for the Gaussian model. We are also working 
on a generalized version of this strategy for the case where 
the transmitters have no channel state information a priori and 
must be informed of the channel through a low-rate feedback 
link. 
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